CHAPTER 9 


Sequences of Functions 


1. Pointwise Convergence 

We have accumulated much experience working with sequences of numbers. 
The next level of complexity is sequences of functions. This chapter explores 
several ways that sequences of functions can converge to another function. The 
basic starting point is contained in the following definitions. 

Definition 9.1. Suppose S c IR and for each n e N there is a function f n : 
S —► HB. The collection {f n : n e N} is a sequence of functions defined on S. 

For each fixed x e S, f n (x) is a sequence of numbers, and it makes sense to 
ask whether this sequence converges. If f n (x) converges for each x e S, a new 
function /: S — IR is defined by 

/(x)= lim f n {x). 

n—>oo 

The function / is called the pointwise limit of the sequence f n , or, equivalently, it 
is said f n converges pointwise to /. This is abbreviated f n —»/, or simply f n — /, 
if the domain is clear from the context. 


Example 9.1. Let 


fn(x) = ' 


0 , 

x n 

1 , 


x < 0 
0 < x < 1 . 
x> 1 


Then f n —* / where 


/(*) = 



(See Figure 1.) This example shows that a pointwise limit of continuous functions 
need not be continuous. 


Example 9.2. For each n e \ 


1, dehne f n : IF 
nx 

fnW = 


I by 


1 + n 2 x 2 

(See Figure 2.) Clearly, each f n is an odd function and lim^i^oo f n (x) = 0. A bit of 
calculus shows that f n [l/n) = 1/2 and f n (-\ln) = -1/2 are the extreme values of 
f n . Finally, if x ^ 0, 


\fn(x)\ = 


nx 

< 

nx 


1 

1 + n 2 x 2 

n 2 x 2 


nx 
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Figure 1. The first ten functions from the sequence of Example 9.1. 



FlGURE 2. The first four functions from the sequence of Example 9.2. 


implies f n — 0. This example shows that functions can remain bounded away 
from 0 and still converge pointwise to 0. 


Example 9.3. Define f n : 

fn(x) = < 


:by 


^2/1+4 _ ^n+3 


-2 

0, 


2n+A 


x + 2 


n +4 


2 FFT<*< 2^2 

_ 3 _ < Y <L — 

2«+2 — ■ A/ ^ 2 n 

otherwise 


To figure out what this looks like, it might help to look at Figure 3. 

The graph of f n is a piecewise linear function supported on [l/2” +1 ,1/2”] and 
the area under the isosceles triangle of the graph over this interval is 1. Therefore, 
fo fn = 1 for all n. 

If x > 0, then whenever x > 1/2”, we have f n (x) = 0. From this it follows that 

fn - 0. 

The lesson to be learned from this example is that it may not be true that 

lim n ^oo fo fn = fo Ihlbi^oo f n - 
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FlGURE 3. The first four funcdons f n —* 0 from the sequence of Exam- 
ple 9.3. 



FlGURE 4. The first ten functions of the sequence f n —► \x\ from Ex- 
ample 9.4. 


Example 9.4. Define /„ : R —>• K by 


fn M = 


— X^ H—— I r| < — 
2 X ^ 2n } |X| - n 

W, l x l>^ 


(See Figure 4.) The parabolic section in the center was chosen so f n (+1 / n) = 1 / n 
and //,(+l/n) = ±1. This splices the sections together at {±l/n, ±l/n) so f n is 
differentiable everywhere. It’s clear f n — |xj, which is not differentiable at 0. 

This example shows that the limit of differentiable functions need not be 
differentiable. 
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The examples given above show that continuity, integrability and differen- 
tiability are not preserved in the pointwise limit of a sequence of functions. To 
have any hope of preserving these properties, a strenger form of convergence is 
needed. 


2. Uniform Convergence 

Definition 9.2. The sequence f„: S-*U converges uniformly to /: S —• IR 
on S, if for each e > 0 there is an N e N so that whenever n> N and xe S, then 
\fn(x)~ f{x)\ <£. 

In this case, we write f„ Z, f, or simply f n =t /, if the set S is clear from the 
context. 



a b 

FlGURE 5. | f„[x) - f{x )| < e on [a, b], as in Definition 9.2. 

The difference between pointwise and uniform convergence is that with 
pointwise convergence, the convergence of f n to / can vary in speed at each 
point of S. With uniform convergence, the speed of convergence is roughly the 
same all across S. Uniform convergence is a strenger condition to place on the 
sequence f n than pointwise convergence in the sense of the following theorem. 

Theorem 9.3. If f n ^ /, then /. 

Proof. Let xo e S and e > 0. There is an N e N such that when n> N, then 
|/(x) -/„(x)| < £ for all xe S. In particular, |/(xo) -/„(xo)| < £ when n>N. This 
shows f n (xo) -* fix o). Since xo e S is arbitrary, it follows that /„ — /. □ 

The first three examples given above show the converse to Theorem 9.3 
is false. There is, however, one interesting and useful case in which a partial 
converse is true. 

Definition 9.4. If/, ; —*•/ and ffx)} fix) for all x e S, then /„ increases to / 
on S. If f, —*■/ and f n ix) [ fix) for all xe S, then f n decreases to / on S. In either 
case, f n is said to converge to / monotonically. 
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The functions of Example 9.4 decrease to |x|. Notice that in this case, the con- 
vergence is also happens to be uniform. The following theorem shows Example 
9.4 to be an instance of a more general phenomenon. 

Theorem 9.5 (Dini’s Theorem). If 

(a) S is compact, 

(b) f n —►/ monotonically, 

(c) f n £ C(S) for all n £ N, and 

(d) feC[S), 
then f n =t /. 

Proof. There is no loss of generality in assuming f n \ /, for otherwise we 
consider -f n and -/. With this assumption, if g n = fn~ f, then g n is a sequence 
of continuous functions decreasing to 0. It suffices to show g n =t 0. 

To do so, let £ > 0. Using continuity and pointwise convergence, for each 
x £ S find an open set G x containing x and an N x £ N such that gN x (y) < £ for all 
y £ G x . Notice that the monotonicity condition guarantees g n (y) < e for every 
y £ G x and n > N x . 

The collection {G x : x £ S} is an open cover for S, so it must contain a finite 
subcover {G Xi : 1 < i < n}. Let N = ma x{N Xi : 1 < i < n] and choose m> N. If 
x £ S, then x £ G Xi for some i, and 0 < g m (x) < gjv(x) < gjv, (x) < e. It follows that 
gn =* 0. □ 



FlGURE 6. This shows a typical function from the sequence of Exam¬ 
ple 9.5. 


Example 9.5. Let f n (x) = x” for n e N, then f n decreases to 0 on [0,1). If 0 < 
a < 1 Dini’s Theorem shows f n =t 0 on the compact interval [0, a]. On the whole 
interval [0,1), f n (x) >1/2 when 2~ l,n < x < 1 , so f n is not uniformly convergent. 
(Why doesn’t this violate Dini’s Theorem?) 
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3. Metrie Properties of Uniform Convergence 

If S c IR, let B[S) = {/ : S — R : / is bounded}. For / e B(S), define ||/||s = 
lub{|/(x)| : x e S}. (It is abbreviated to ||/||, if the domain S is clear from the 
context.) Apparently, ||/|| > 0, ||/|| = 0 <=> / = 0 and, if g e B{S), then ||/- g|| = 

|| g - /||. Moreover, if h e B[S), then 

ll/-gll = lub{|/(x)-g(x)| :xeS) 

< lub{|/(x) - h(x) | + \h{x) - g(x)| :xeS} 

<lub{|/(x)-/i(x)| :xe S} + lub{|fo(x) -g(x)| :xeS} 

= ||/-7l|| + ||ft-gll 

Combining all this, it follows that ||/- g|| is a metric 1 on BfS). 

The definition of uniform convergence implies that for a sequence of bounded 
functions f n : S —>■ IR, 

/„=*/«• ll/«-/ll-o. 

Because of this, the metric 11/ - g|| is often called the uniform metric or the 
sup-metric. Many ideas developed using the metric properties of R can be car- 
ried over into this setting. In particular, there is a Cauchy criterion for uniform 
convergence. 

Definition 9.6. Let S a R. A sequence of functions /„ : S —>■ R is a Cauchy 
sequence under the uniform metric, if given e > 0, there is an N e N such that 
when m,n>N, then II f n ~ fm II < £• 

Theorem 9.7. Let /„ e B(S). There is afunction f e B(S) such that f n =t f iff 
f n is a Cauchy sequence in B (S). 

Proof. (=>) Let f n =t / and e > 0. There is an N e N such that n> N implies 
ll/fi _ /II < e/2. If m > N and n> N, then 

II fm ~ fn II ^ Wfm- f\\ + \\f- fn\\ K \ + \ = £ 
shows f n is a Cauchy sequence. 

(<=) Suppose f n is a Cauchy sequence in B(S] and e > 0. Choose Ai e N so 
that when \\f m - f n || < e whenever m> N and n> N. In particular, for a fixed 
x 0 eS and m, n > N, \f m (x 0 ) - f n {x 0 ) I < Wfm - fn II < £ shows the sequence f n {x 0 ) 
is a Cauchy sequence in R and therefore converges. Since xo is an arbitrary point 
of S, this defines an /: S — R such that /„ —• /. 

Finally, if m, n > N and xe S the fact that | f n (x) - f m (x) | < £ gives 

\fn(x)-f(x)\= lim |/j(x)-/ m (x)| <E. 

m—oo 

This shows that when n> N, then ||/„ - f\\ < e. We conclude that f e B[S) and 

fn =t /• □ 


1 Definition 2.11 
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A collection of functions SP is said to be complete under uniform convergence, 
if every Cauchy sequence in SP converges to a function in SP. Theorem 9.7 shows 
BIS) is complete under uniform convergence. Weil see several other collections 
of functions that are complete under uniform convergence. 

Example 9.6. For S c IR let I(S) be all the functions / : S — IR such that 
fix) = mx + b for some constants m and b. In particular, let f n be a Cauchy 
sequence in L([0,1]). Theorem 9.7 shows there is an / : [0,1] -» R such that 
f n =t /. In order to show L([0,1]) is complete, it suffices to show / e L([0,1]). 

To do this, let f n (x) = m n x+b n for each n. Then f n (0) = b n -* /(0) and 

m„ = /„(l)-h„-/(l)-/(0). 

Given any x e [0,1], 

fn (x) - ((/(1) - /(0))x + /(0)) = m n x + b n - ((/(1) - /(0))x + /(0)) 

- [m n - (/(1) - / (0)))x + b n - fi 0) - 0. 

This shows fix) = (/(1) - /(0))x + /(0) e L([0,1]) and therefore L([0,1]) is com¬ 
plete. 

Example 9.7. Let SP = {pix): p is a polynomial}. The sequence of polynomi- 
als p n ix) = T.'^ =0 x k /k\ increases to e x on [0, a ] for any a > 0, so Dini’s Theorem 
shows p„ =t e x on [0, a\. But, e x € SP, so SP is not complete. (See Exercise 7.7.25.) 

4. Series of Functions 

The dehnitions of pointwise and uniform convergence are extended in the 
natural way to series of functions. If fk is a series of functions dehned on a 

set S, then the series converges pointwise or uniformly, depending on whether 
the sequence of partial sums, s n = ZjjLj/fc converges pointwise or uniformly, 
respectively. It is absolutely convergent or absolutely uniformly convergent, if 
fn is convergent or uniformly convergent on S, respectively. 

The following theorem is obvious and its proof is left to the reader. 

Theorem 9.8. Let L“ =1 f n be a series of functions deflned on S. //'L“ =1 fn 
is absolutely convergent, then it is convergent. IfJ_f‘ =] f„ is absolutely uniformly 
convergent, then it is uniformly convergent. 

The following theorem is a restatement of Theorem 9.5 for series. 

Theorem 9.9. Ifjf^ =1 f n is a series of nonnegative continuous functions con- 
verging pointwise to a continuous function on a compact set S, then Yf^ = \fn 
converges uniformly on S. 

A simple, but powerful technique for showing uniform convergence of series 
is the following. 

Theorem 9.10 (Weierstrass M-Test). Iff n : S — isa sequence of functions 
and M n is a sequence nonnegative numbers such that ||/ ; Js < M n for all /ieN 
andJfff =l M n converges, then ] f n is absolutely uniformly convergent. 
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Proof. Let £ > 0 and s n be the sequence of partial sums of \fn\- Using 

the Cauchy criterionfor convergence of aseries, choose an ATeN such thatwhen 
n> m> N, then T. k=m M k < e. So, 

n n n 

IUn-Smll = II L fk II- L H/fcll ^ E M k <£ - 

lc=m+l k=m +1 k=m 

This shows s n is a Cauchy sequence and must converge according to Theorem 9.7. 

□ 


Example 9.8. Let a > 0 and M n = a n ln\. Since 


.. M n +1 
lim -= lim 


a 


n^oo M„ 


»—oo n + 1 


- 0 , 


the Ratio Test shows E“ =n M n converges. When x e \-a, a\, 


x“ 

n\ 


n\ 


The Weierstrass M-Test now implies X>1 ! n - converges absolutely uniformly 
on [-a, a] for any a > 0. (See Exercise 9.4.) 


5. Continuity and Uniform Convergence 

Theorem 9.11. If f n : S — IR is such that each f n is continuous at xo and 
f n __ f, then f is continuous at x () . 

Proof. Let e > 0. Since f n =: /, there is an Ne N such that whenever n> N 
and xeS, then \f n W - fix) \ < e/3. Because /n is continuous at xo, there is a 
ö > 0 such that x e (xo - 5, xo + 8) n S implies I/jvM - /jv(^o)I < c/3. Using these 
two estimates, it follows that when x e (xo - 8, xo + 5) n S, 

|/(x)-/(x 0 )| = l/(x)-/iv(x) + / w (x)-/iv(xo) + /jv(*o)-/(*o)| 

< |/(x) -/jv(x)| + 1/ivW -/iv(xo)| + |/iv(xo) -/(x 0 )| 

< e/3 + £/3 + £/3 = £. 

Therefore, / is continuous at xo. □ 

The following corollary is immediate from Theorem 9.11. 

Corollary 9.12. If f n is fl sequence of continuous functions converging uni¬ 
formly to f on S, then f is continuous. 

Example 9.1 shows that continuity is not preserved under pointwise conver¬ 
gence. Corollary 9.12 establishes that if S is compact, then C(S) is complete under 
the uniform metric. 

The fact that C([fl, b]) is closed under uniform convergence is often useful 
because, given a “bad” function / e C([fl, b]), it’s often possible to find a sequence 
f n of “good” functions in C{[a, b\) converging uniformly to /. Following is the 
most widely used theorem of this type. 

Theorem 9.13 (Weierstrass Approximation Theorem). Iff e C([fl, b]), then 
there is a sequence of polynomials p n /. 
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To prove this theorem, we first need a lemma. 

Lemma 9.14. For n e N letc n = (/.Ijü - t 2 ) n dij and 


k n (t) — 


[c„{l-t 2 ) n , 

1°- 


m<i 
in > i' 


(See Figure 7.) Then 

(a) k n {t) >0 for all t eU and neN; 

(b) /_ 1 k n = 1 for all n e N; and, 

(c) ifO < 5 < 1, then k n =t 0 on (-oo,-5] u [<5,oo). 



Figure 7. Here are the graphs of k n {t) for n = 1,2,3,4,5. 


Proof. Parts (a) and (b) follow easily from the definition of k n . 
To prove (c) first note that 


1 = 


/>/. 


1 l\/n 




c n [l-t 2 ) n dt>c n — 
\Jn 


1 -- 

n) 


Since (l — ” | ^, it follows there is an a > 0 such that c n < a\fh. 1 Letting 5 e (0,1) 

and Ö < t < 1, 

k n {t) < k n {5) < a\fn{l-S 2 ) n — 0 


by L’Hospital’s Rule. Since k n is an even function, this establishes (c). □ 


2 Repeated application of Integration by parts shows 

n + 112 n- 1/2 n-3/2 3/2 r(w + 3/2) 

C n = - x - x - x • • • x - = --. 

n n -1 n- 2 1 fnTin+l) 

With the aid of Stirling’s formula, it can be shown c n ~ 0.565 fn. 
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A sequence of functions satisfying conditions such as those in Lemma 9.14 is 
called a convolution kernel or a Dirne sequence Several such kerneis play a key 
role in the study of Fourier series, as we will see in Theorems 10.5 and 10.13. The 
one defined above is called the Landau kernel. * * * 4 

We now turn to the proof of the theorem. 


Proof. There is no generalily lost in assuming \a, b] = [0,1], for otherwise we 
consider the linear change ofvariables g(x) = f((b- a)x+ a). Similarly, we can 
assume /(0) = /(1) = 0, for otherwise we consider g(x) = /(x) - ((/(1) - /(0))x - 
/(0), which is a polynomial added to /. We can further assume /(x) = 0 when 
xt [0,1], 

Set 


(82) 


Pn(x) 



+ t)k n [t)dt. 


To see p n is a polynomial, change variables in the integral using u = x+t to arrive 
at 


PnW 


cX+l 

J x— 1 




f{u)k n {u-x)du= | f(u)k n (x-u)du, 


because /(x) = 0 when x £ [0,1]. Notice that k n [x- u) is a polynomial in u 
with coefficients being polynomials in x, so integrating f(u)k n (x - u) yields a 
polynomial in x. (Just try it for a small value of n and a simple function /!) 

Use (82) and Lemma 9.14(b) to see for 8 e (0,1) that 


(83) I Pn (x) f (x) | 


-\i: 


f{x+ t)k n {t) dt- fix) 

l 




(/(x+ t)- f{x))k n {t) dt 




|/(x+ t)- f(x)\k n (t) dt 

= [ |/(x+ t)-f(x)\k n (t)dt + f |/(x+ t)-f(x)\k n (t)dt. 
J-S J<5<|r|<l 

Weil handle each of the final integrals in turn. 

Let e > 0 and use the uniform continuity of / to choose a 8 e (0,1) such that 
when 1 1\ < 8, then |/(x+ t ) - /(x)| < e/2. Then, using Lemma 9.14(b) again, 


(84) 


r s e r s e 

I |/(x+ t)-f(x)\k„{t)dt < - / k n [t)dt < - 

J-5 2 J-s 2 


o 

Given two functions / and g defined on IR, the convolution of / and g is the integral 





fWgix- 


t)dt. 


The term convolution kernel is used because such kerneis typically replace g in the convolution 
given above, as can be seen in the proof of the Weierstrass approximation theorem. 

4 It was investigated by the German mathematician Edmund Landau (1877-1938). 
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AccordingtoLemma 9.14(c), thereisan Ne N so thatwhen n> N and 1 1\ > 8, 
then k n (t) < sai/H+uu-g) • Using this, it follows that 


(85) 


f \f(x+t)-f{x)\k n {t)dt 


J \f{x+t)-f{x)\k n {t)dt + J \f(.x+t)-f[x)\k n {t) 


dt 


<211 




k n {t)dt + 2|| 




k n {t)dt 


<211 


8(||/|| +1)(1 — 5) 


(l-d)+2[| 


8(||/|| + 1) (1 —5) 


(1-5) 


£ 

2 


Combining (84) and (85), it follows from (83) that |p, ; (x)-/(x)| < e for all x e [0,1] 
and p n /. □ 


Corollary 9.15. Iff e C{[a, b ]) and e > 0, then there is a polynomial p such 
that Wf-p\\[aM <£■ 

The theorems of this section can also be used to construct some striking 
examples of functions with unwelcome behavior. Following is perhaps the most 
famous. 


Example 9.9. There is a continuous /: IR — IR that is differentiable nowhere. 


Proof. Thinking of the canonical example of a continuous function that 
fails to be differentiable at a point—the absolute value function—we Start with a 
“sawtooth” function. (See Figure 8.) 


So(x) = 


) x-2n, 

2n + 2- x, 


2n < x < 2n + 1, ne Z 
2n+l<x<2n + 2, ne l 


Notice that so is continuous and periodic with period 2 and maximum value 1. 
Compress it both vertically and horizontally: 


S n (X ) = 


(3\ n 

-J 5o(4”x),neN. 


Each s n is continuous and periodic with period p n = 2/4" and || s n || = (3/4)". 



Figure 8. so. and s 2 from Example 9.9. 
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3.0 

2.5 

2.0 

1.5 

1.0 

0.5 



Figure 9. The nowhere differentiable function / from Example 9.9. 


Finally, the desired function is 

oo 

fix) = y Snix). 

n =0 

Since ||s„|| = (3/4)”, the Weierstrass M-test implies the series dehning / is uni- 
formly convergent and Corollary 9.12 shows / is continuous on IR. We will show 
/ is differentiable nowhere. 

Let x e R, m e N and h m = 1 / (2 • 4'”). 

If n > m, then h m lp n = 4” _m_1 e N, so s„(x± h m ) - s n (x) = 0 and 

fix ± h m )-fix) ™ s k ix±h m )- Skix) 
i“m 0 


On the other hand, if n < m, then a worst-case estimate is that 
s n ix±h m )- s n ix) 


This gives 


(87) 


h r . 



(3)” , 

1 

< 

- / 

— 


Ui 



= 3 n . 


ihr 


sjcixi h m )-s k ix) s k ix±h m )~ s k ix) 

k=o 


* L 

k= 0 

3 m -1 


< 

3-1 2 


ihm 

3 m 


Since s m is linear on intervals of length 4 m = 2 • h m with slope ±3 m on those 
linear segments, at least one of the following is true: 


( 88 ) 


s m ix+h m )-six) 

= 3 m or 

s m ix-h m )- six) 

hm 

~ h m 



Suppose the first of these is true. The argument is essentially the same in the 
second case. 
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Using (86), (87) and (88), the following estimate ensues 








>3 m -= —. 

2 2 


Since 3 m /2 —► oo, it is apparent fix) does not exist. 


□ 


There are many other constructions of nowhere differentiable continuous 
functions. The first was published by Weierstrass [2 ] in 1872, although it was 
known in the folklore sense among mathematicians earlier than this. (There is 
an English translation of Weierstrass’ paper in [10].) In fact, it is now known in a 
technical sense that the “typical” continuous function is nowhere differentiable 
[4]. 


6. Integration and Uniform Convergence 

One of the recurring questions with integrals is when it is true that 



This is often referred to as “passing the limit through the integral.” At some 
point in her career, any Student of advanced analysis or probability theory will 
be tempted to just blithely pass the limit through. But functions such as those of 
Example 9.3 show that some care is needed. A common criterion for doing so is 
uniform convergence. 

Theorem 9.16. Iff n : [a, b) — IR such that f n existsfor each n and f n =£ / 
on [a,b], then 



Proof. Some care must be taken in this proof, because there are actually 
two things to prove. Before the equality can be shown, it must be proved that / is 
integrable. 
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To show that / is integrable, let e > 0 and IV e N such that || /- /jvll < £ /3 [b-ä). 
IfPe part {[a,b]), then 


(89) 


■ (f,P,x* k )-8Z(f N ,P,x* k )\ = | £ f(x* k )\I k \- £ /iv(xp|Jfc|| 

fc=i fc=i 

N 

= iL(/^P-/iv(4wi / fcii 

i-=i 

N 

~ E l/(xp-/iv(xp|l4-| 

fc=l 

n 


< 


■ E i4i 


3(b-a)) p, 

_ £ 

~~ 3 

According to Theorem 8.10, there is a P e part([a, h]) such that whenever 
P « Qi and P « Q 2 , then 


(90) 


K/iv,Q 1 ,x*)-^(/iv,Q2,yfc)l<^ 


Combining (89) and (90) yields 

|^(/,Qi,x*)-<%(/,Q 2 ,y£)| 

= |äe(/, Ql,X*) -se(/iv, Ql,X*) + ^(//v,Ql,X*) 

(/w, Qi, x£) + se (/iv, Q 2 , Tfc) - SA (/, Q 2 , y£)I 
< |SA (/, Ql, X^) - SA (f N , Qi,x^)| +1 SA ( f N , Qi, x* k ) - SA [f N , Qi, x * k )| 

+ |SA {f N , Q 2 ,y* k ) - SA (/, Q 2 , Tfc) | 


£ £ £ 

<-1-1- — £ 

333 


Another application of Theorem 8.10 shows that / is integrable. 

Finally, when n> N, 

I [ b . [ b , \[ b ff .. [ b £ £ 

I jj-jj" = |i (/ -" U 3(^) = 3 <£ 

shows that□ 

Corollary 9.17. IfTS^Lifn is « series of integrable functions converging 
uniformly on [a, b], then 

rb oo oo nb 

/ E 4 = E / /« 

0,0 «=1 n=\^ a 

Example 9.10. It was shown in Example 4.2 that the geometric series 

OO 1 

f t"=-, —1 < f< 1. 

„=o 1 -f 
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In Exercise 9.3, you are asked to prove this convergence is uniform on any com¬ 
pact subset of (-1,1). Substituting -f for t in the above formula, it follows that 


OO 1 

I ~t 

n=0 1 + 1 

on [0, x], when 0 < x < 1. Corollary 9.17 implies 
" x dt 


r x dt °° r x 

ln(l + x) = I -= V (— t) dt 

Jo 1 -t - t n—0 J® 


2 S 4 

= JC- JC + X - X H-. 


The same argument works when -1 < x < 0, so 

ln(l + jc) = x - x 2 + x 3 - x 4 H— 


when ie(-l,l). 

Combining Theorem 9.16 with Dini’s Theorem, gives the following. 

Corollary 9.18. Iff n is a sequence ofcontinuousfunctions converging mono- 
tonically to a continuous function f on [a , b], then f% f n -» f% f. 


7. Differentiation and Uniform Convergence 

The relationship between uniform convergence and differentiation is some- 
what more complex than those we’ve already examined. First, because there are 
two sequences involved, f n and ff either of which may converge or diverge at a 
point; and second, because differentiation is more “delicate” than continuity or 
integration. 

Example 9.4 is an explicit example of a sequence of differentiable functions 
converging uniformly to a function which is not differentiable at a point. The 
derivatives of the functions from that example converge pointwise to a function 
that is not a derivative. The Weierstrass Approximation Theorem and Example 9.9 
push this to the extreme by showing the existence of a sequence of polynomials 
converging uniformly to a continuous nowhere differentiable function. 

The following theorem Starts to shed some light on the Situation. 

Theorem 9.19. Iff„ is a sequence of derivatives deflned on \a, b] and f n =f /, 
then f is a derivative. 

Proof. For each n, let F n be an antiderivative of /„. By considering F n (x) - 
F n (a), if necessary, there is no generality lost with the assumption that F n (fl) = 0. 

Let £ > 0. There is an N e N such that 

m,n> N => II fm — fn II < ~r~ • 

b-a 

If x e [fl, b] and m,n> N, then the Mean Value Theorem and the assumption that 
F m {a) = F n {ä) = 0 yield a c e [fl, b] such that 

I F m (x) -F n ix )| = | (F m (x) - F n (x)) - (F m (fl) - F n (fl))| 

(91) = \fm (c) — fn(c)\ |x — fl| < Wfm-fnHb-a) <£. 

This shows F n is a Cauchy sequence in C([fl, b ]) and there is an F e C{[a, b]) with 
Fn =* F. 
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It suffices to show F' = /. To do this, several estimates are established. 

Let MeNso that 

m,n> M => || fm-fn\\ < 

Notice this implies 

(92) ll/-/„ll<|, V«>M. 

For such m,n> M and x ,y e [a,b] with y, another application of the 
Mean Value Theorem gives 

F n ix)-F n {y) F m {x)-F m {y) 
x-y x-y 

= | ( F n (x) - F m (x)) - (F n (y) - F m (y)) | 

Ix —y| 

= | x ^ y | \fn(c)-f m {c)\\x-y\ < \\fn-fm\\ < 


Letting m — oo, it follows that 

F n {x) — F n {y) F(x) — F(y) 


(93) 


< Vn > M. 

x-y x-y 3 

Fix n>M and x e [a, b ]. Since F' n (x) = f n (x), there is a 5 > 0 so that 


(94) 


F„(x)-F„(y) 


-fn M 


x-y 

Finally, using (93), (94) and (92), we see 
F(x)-F(y) 


< -, Vy £ (x-<5,x + <5) \{x}. 


x-y 


/(x) 


F(x) - F(y) F n (x) - F n (y) 
x-y 

F n (x)-F n (y) 


x-y 


+ 


x-y 

F(x) -F{y) F n {x)-F n {y) 


fn(x) + fn (x) — f (x) 


x-y 


+ 


x-y 

F n (x) ~ F n (y) 


x-y 


~ fn (x) 


+ 


| fn (x) — f (x) | 


SEE 

<- 1 - 1 -— £. 

3 3 3 


This establishes that 


as desired. 


F{x) - F(y) ^ , 

lim-= /(x), 

x-y 


□ 


Corollary 9.20. IfG n e C[[a,b]) is a sequence such thatG' n =t g andG n {x o) 
convergesforsome x o e [a, /i|, t/ien G (i G whereG' = g. 
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Proof. Suppose G„(x 0 ) — a. For each n choose an antiderivative F n of g n 
such that F n {ä) = 0. Theorem 9.19 shows g is a derivative and an argument 
similar to that in the proof of Theorem 9.19 shows F n =t F on [a, b], where F' = g. 
Sine eF' n -G' n = 0, Corollary (7.16) shows G n {x) = F n (x) + (G n (xo)- F n (xo)). Dehne 
G(x) = F(x) + (a - F(xo)). 

Let e > 0 and xe [a,b]. There is an N e N such that 



If n > N, 

I Gn (x) - G(x)| = \F n (X) + [Gn (xo) - F n (x 0 )) - [F[x] + [a-F[x 0 ))) | 
< |F„(x) -F(x)| + |G„(x 0 ) -a\ + |F„(x 0 ) - F(x 0 )| 



= £ 


This shows G n =tGon [a, b ] where G' = F 1 = g. 


□ 


Corollary9.21. Iff n isasequence ofdifferentiablefunctionsdefinedon \a, b] 
such thatY^ =l A-(xo) exists for some xo e [a,b] andY^ =l f' k converges uniformly, 
then 


' oo oo 


1 / =Tf 


k fc= 1 k= 1 


Proof. Left as an exercise. 


□ 


Example 9.11. Let a > 0 and f n [x) = x n ln\. Note that = f n -\ for n e N. 
Example 9.8 shows £^ 0 //;(x) is uniformly convergent on [~a,a\. Corollary 9.21 
shows 



(95) 


on [-a, a\. Since a is an arbitrary positive constant, (95) is seen to hold on all of 

re. 

If /(x) = x ' l l n '-< then the argument given above implies the initial value 

problem 


f[x) = /(x) 
/( 0 ) = 1 


As is well-known, the unique solution to this problem is /(x) = e x . Therefore, 


oo v n 



8. Power Series 


8.1. The Radius and Interval of Convergence. One place where uniform 
convergence plays a key role is with power series. Recall the dehnition. 
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Definition 9.22. A powerseries is a function ofthe form 

OO 

(96) f{x)=Y, a n(x-c) n . 

n=0 

Members of the sequence a n are the coefficients of the series. The domain of / is 
the set of all x at which the series converges. The constant c is called the center of 
the series. 


To determine the domain of (96), let x e IR \ {c} and use the root test to see the 
series converges when 

limsup|a„(x- c) n \ yn = |je — c|limsup|a, 7 | 1/,! < 1 


and diverges when 

Ix-cllimsuplanl 17 " > 1. 

If rlimsup \a n \ lln < 1 for some r > 0, then these inequalities imply (96) is abso- 
lutely convergent when | jc - c| < r. In other words, if 

(97) R = lub{r : rlimsuplflnl 1 ^'< 1}, 


then the domain of (96) is an interval of radius R centered at c. The root test gives 
no information about convergence when \ x — c\ = R. This R is called the radius of 
convergence of the power series. Assuming R > 0, the open interval centered at c 
with radius R is called the interval of convergence. It may be different from the 
domain of the series because the series may converge at one endpoint or both 
endpoints of the interval of convergence. 

The ratio test can also be used to determine the radius of convergence, but, 
as shown in (31), it will not work as often as the root test. When it does, 


(98) 


R = lub{r : r lim 

n —oo 


t^ii+1 

fl-n 


<!}• 


This is usually easier to compute than (97), and both will give the same value for 
R. 


Example 9.12. Calling to mind Example 4.2, it is apparent the geometric 
power series h as center 0, radius of convergence 1 and domain (-1,1). 

Example 9.13. For the power series 2"(x + 2 ) n ln, we compute 


limsup 


2 n \ i / n 

— I =2 

n 


1 

R= 

2 


Since the series diverges when x = -2 ± \, it follows that the interval of conver¬ 
gence is (-5/2,-3/2). 


Example 9.14. The power series Yfff=\X n !n has interval of convergence 
(-1,1) and domain [-1,1). Notice it is not absolutely convergent when x = -1. 

Example 9.15. The power series Y, c f’ =1 x n / n 2 has interval of convergence 
(-1,1), domain [-1,1] and is absolutely convergent on its whole domain. 


The preceding is summarized in the following theorem. 
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Theorem 9.23. Let the power series be as in (96) and R be given by either (97) 


or (98). 


(a) IfR = 0, Chen the domain ofthe series is {c}. 

(b) If R > 0 the series converges absolutely at x when c - x| < R and 
divergesatx when\c-x\ > R. In the case when R = oo, the series converges 
everywhere. 

(c) IfR £ (0, oo), then the series may converge at none, one or both ofc - R 
andc + R. 

8.2. Uniform Convergence of Power Series. The partial sums of a power 
series are a sequence of polynomials converging pointwise on the domain of the 
series. As has been seen, pointwise convergence is not enough to say much about 
the behavior of the power series. The following theorem opens the door to a lot 
more. 

Theorem 9.24. A power series converges absolutely and uniformly on compact 
subsets ofits interval of convergence. 

Proof. There is no generality lost in assuming the series has the form of (96) 
with c = 0. Let the radius of convergence be R > 0 and K be a compact subset of 
i-R,R) with a = lub{|x|: x £ K}. Choose r £ ( a,R ). If x £ K, then \a n x n \ < \a n r n \ 
for n e N. Since 1 a n r n \ converges, the Weierstrass M-test shows L“ = o a nX n 
is absolutely and uniformly convergent on K. □ 

The following two corollaries are immediate consequences of Corollary 9.12 
and Theorem 9.16, respectively. 

Corollary 9.25. A power series is continuous on its interval of convergence. 

Corollary 9.26. If [a, b\ is an interval contained in the interval of conver¬ 
gence for the power series L“ =0 a n (x - c)", then 


b oo oo rb 


£ a n lx-c) n = £ a n / (x-c)". 


a n = o n=0 4a 


Example9.16. Define 



Since /(x) = 1, / is continuous everywhere. Suppose we want fj f with 

an accuracy of five decimal places. 


Ifx^O, 



July 13, 2016 


http: / / math.louisville.edu/ ~lee / ira 




9-20 


CHAPTER 9. SEQUENCES OF FUNCTIONS 


The latter series converges to / everywhere. Corollary 9.26 implies 


(99) 


rn nJT I oo 

/ fix) dx= X 

t/0 JO \/2=[ 


(-1)” 2 n 

-X 


= E 


o (2« + 1)! 
oo rK 


dx 


-f 

)Uo 


„Tq (2n + 1)! Jo 

oo (-1)« 


x 2 " (Jx 


= E 


n 


(2n+l)(2«+l)! 


-7T 


2n+l 


The latter series satisfies the Alternating Series Test. Since tt 1 5/ (15 x 15!) = 1.5 x 
10 -6 , Corollary 4.20 shows 


r-n 6 

I f{x) dx « ^ 

JO n=( 


(-D' 


-n 


2n +1 


o [2n + l)(2n+ 1)! 


1.85194 


The next question is: What about differentiability? 

Notice that the continuity of the exponential function and L’Hospital’s Rule 


lim n lln 

ft—OO 


= lim exp 

ft—OO 





= exp 


lim 

ft—oo 



= exp(0) = 1. 


Therefore, for any sequence a n , 

(100) limsuplna,,) 1 ^ = limsup n lln a„ n = limsup fl, 1 /”. 


Now, suppose the power series E^L 0 a n x n has a nontrivial interval of con- 
vergence, I. Formally differentiating the power series term-by-term gives a new 
power series na n x n ~ l . According to (100) and Theorem 9.23, the term-by- 
term differentiated series has the same interval of convergence as the original. 
Its partial sums are the derivatives of the partial sums of the original series and 
Theorem 9.24 guarantees they converge uniformly on any compact subset of /. 
Corollary 9.21 shows 

OO OO fl oo 

— y a n x n = y —a n x n = y na n x n ~ l , Vx e /. 

n =0 n=0 n= i 

This process can be continued inductively to obtain the same results for all higher 
order derivatives. We have proved the following theorem. 


Theorem 9.27. If fix) = a nix ~ c) n is a power series with nontrivial 
interval of convergence, I, then f is differentiable to all Orders on I with 


( 101 ) 


f im] ix) = £ 


n\ 


=m in-m)\ 


a n ix-c)' 


Moreover, the differentiated series has I as its interval of convergence. 
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8.3. Taylor Series. Suppose fix) = L^ 0 a n x tl has / = [-R, R ) as its interval 
of convergence for some R > 0. According to Theorem 9.27, 


f {m \ 0) 


m! 

- a 

(m - m)\ 


a m =-, Vme to. 

m\ 


Therefore, 


00 f (n) fOl 

/(*)=£ J —^ xn ' Vxe/ - 
«=o n\ 


This is a remarkable result! It shows that the values of / on / are completely 
determined by its values on any neighborhood of 0. This is summarized in the 
following theorem. 


Theorem9.28. Ifa power series f (x) = a nlx-c) n has nontrivial interval 
of convergence I, then 

oo An)( c \ 

(102) /(x)=V- --u-c)", Viel. 

n - 


The series (102) is called the Taylor series 5 for / centered at c. The Taylor 
series can be formally defined for any function that has derivatives of all Orders at 
c, but, as Example 7.9 shows, there is no guarantee it will converge to the function 
anywhere except at c. Taylor’s Theorem 7.18 can be used to examine the question 
of pointwise convergence. If / can be represented by a power series on an open 
interval /, then / is said to be analytic on I. 


8.4. The Endpoints of the Interval of Convergence. We have seen that at 
the endpoints of its interval of convergence a power series may diverge or even 
absolutely converge. A natural question when it does converge is the following: 
What is the relationship between the value at the endpoint and the values inside 
the interval of convergence? 

Theorem 9.29 (Abel). A power series is continuous on its domain. 

Proof. Let fix) = c) n have radius of convergence R and interval of 

convergence I. If I = {0}, the theorem is vacuously true from Deünition 6.9. If 
I = R, the theorem follows from Corollary 9.25. So, assume R e (0,oo). It must be 
shown that if / converges at an endpoint of / = (c - R, c + R) , then / is continuous 
at that endpoint. 

It can be assumed c = 0 and R = 1. There is no loss of generality with either 
of these assumptions because otherwise just replace f{x) with /((x + c)/R). The 
theorem will be proved for a = c + R since the other case is proved similarly. 


5 When c = 0, it is often called the Maclaurin series for /. 
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Set 5 = /(l), s_! = 0 and s n = flfc for necj. For |x| < 1, 


E a kX k = Y J ^k~s k -i)x k 

k =0 k =0 

= E S kX k ~ E S k-\X k 

k =0 k =1 

rc -1 rc -1 

= 5„x n + e - * E 

fc=0 k= 0 

w-1 

= S n x” + (1 - X) E s kX k 
k =0 


When n^oo, since is bounded and |x| < 1, 


fix) = (1-X) E s kX k . 
k= 0 


(103) 

Since (1 - x) L^ 0 x” = 1, (103) implies 

OO 

(104) l/(x)-s| = (1-x) E isk~s)x k 

k=0 

Let e > 0. Choose JVeN such that whenever n> N, then |s„ - s\ < e/2. Choose 
Ö e (0,1) so 

N 


ö E \Sk-s\ <el2. 


k =0 


Suppose x is such that 1 - 5 < x < 1. With these choices, (104) becomes 


\fix)-s\ < 


N 


(1-x) E( s fc-s)x* 


k= 0 


+ 


(1-x) E i s k-s ): 


k=N+1 


N 


<^E \s k -s\ + - 


k =0 


(1-X) £ ** 

fc=iV+l 


e e 

<-+-=£ 
2 2 


It has been shownthatlim x |i/(x) = /(1), so 1 e Cif). 

Here is an example showing the power of these techniques. 
Example9.17. Theseries 


□ 


Ec-i) 


11 yf n — 


n =0 


1 + X 2 


has (-1,1) asitsintervalofconvergence. If0< |x| < 1, then Corollary 9.17 justifies 

dt r x ~ ~ (-1)" 


r x dt r x °° „ , °° (-1)" 

arctan(x) = I -^ = I E (~1) £ 2 df = E- 

Jo 1 + t 2 Jo to nfo 2n+1 


. 2 n +1 
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This series for the arctangent converges by the alternating series test when x = 1, 
so Theorem 9.29 implies 

00 (-1)" n 

(105) y -= limarctan(x) = arctan(l) = —. 

f^ 0 2n+l x}\ 4 


A bit of rearranging gives the formula 


n = 4 


.111 

1-1-f- • 

v 3 5 7 


which is known as Gregory’s series for n. 


Finally, Abel’s theorem opens up an interesting idea for the summation of 
series. Suppose E^Lo a « i s a ser i es - The Abel sum of this series is 

oo oo 

A y a n = lim y a n x n . 

n =0 "d 1 n =0 


Consider the following example. 


Example9.18. Let a n = (-1)" so 

OO 

£a B = l-l + l-l + l-l + - 

n =0 


diverges. But, 


OO 


■d y — 

n- 0 


oo ^ 

lim V (-x)' ! = lim- 

x}l “o Xtl 1 + X 


1 

2' 


This shows the Abel sum of a series may exist when the ordinary sum does 
not. Abel’s theorem guarantees when both exist they are the same. 

Abel summation is one of many different summation methods used in areas 
such as harmonic analysis. (For another see Exercise 4.4.25.) 


Theorem 9.30 (Tauber). IfY^L 0 a n is a series satisfying 

(a) na n ~* 0 and 

(b) AY.™ =0 a n = A, 
then E“ 0 a n=A. 

Proof. Let s„ = EJLo For x £ (0,1) and n £ N, 


oo 


72 72 

OO 

s n - y 

= 

y a k - y a fc x fc - y a i -x fc 

k= 0 


fc=0 fc=0 

k=n+ 1 


n oo 

y a fc (i-x fc )- y a k x k 

k =0 k=n +1 


n oo 

y flfc(l-x)(l + xH- hx 1 “ 1 )- y a k x k 

k= 0 fc=rc+l 


(106) 


< ( 1 -x) y k\a k \ + y |ßfc|x fc . 

A:=o fc=w+l 
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Let £ > 0. According to (a) and Exercise 3.3.21, there is an IV e N such that 

n 

(107) 


£ 1 ,L £ 
n\a n \ < - and - E k\a k \< -. 


n 


k =0 


n> N 

Let n> N and l-l/n<x<l. Using the right term in (107), 
(108) 


n i n £ 

(l-x)£ k\a k \ < - E k\a k \ < -. 


k =0 


k =0 


Using the left term in (107) gives 


E \ a k\x k < E xt** 

fc=«+l fc=w+l 


(109) 


£ X 


n +1 


< 


2nl- x 


£ 

< 

2 


Combining (107) and (107) with (106) shows 


s n ~ E a kX l 

k =0 


< f. 


Assumption (b) implies s n —► A 


□ 


9. Exercises 


9.1. If /, z (x) = nx(l - x)' ; for 0 < x < 1, then show f n converges pointwise, but 
not uniformly on [0,1]. 

9.2. Show sin” x converges uniformlyon [0,a] for all a e (0,7r/2). Does sin”x 
converge uniformly on [0,7 t/2 )? 

9.3. Show that £ x” converges uniformly on [-r, r] when 0 < r < 1, but not on 

(- 1 , 1 ). 


9.4. Prove x n ln\ does not converge uniformly on R. 

9.5. The series 


cos nx 


E 

n =0 e 

is uniformly convergent on any set of the form |a,oo) with a> 0. 


9.6. A sequence of functions /„ : S — R is uniformly bounded on S if there is an 
M > 0 such that \\f n \\s<M for all n e N. Prove that if f n is uniformly convergent 
on S and each f n is bounded on S, then the sequence f n is uniformly bounded 
on S. 


9.7. Let Sei and c e R. If /„ : S — R is a Cauchy sequence, then so is cf n . 
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9.8. If S c [R and f n , g n : S — R are Cauchy sequences, then so is f n + g n . 

9.9. Let S c IR. If g n : S —• R are uniformly bounded Cauchy sequences, then 

SO is fn&n- 

9.10. Prove or give a counterexample: If f n is a sequence of monotone functions 
converging pointwise to a continuous function /, then f n =s /. 

9.11. Prove or give a counterexample: If f n : [ a, b] — IR is a sequence of monotone 
functions converging pointwise to a continuous function /, then f n f. 

9.12. Prove there is a sequence of polynomials on [a, b] converging uniformly to 
a nowhere differentiable function. 

9.13. Prove Corollary 9.21. 

°o (-1)' 2 

9.14. Prove n = 2\/3 V -. (This is the Madhava-Leibniz series which 

„t' 0 3' 1 (2n + l) 

was used in the fourteenth Century to compute n to 11 decimal places.) 

00 x n 

9.15. If exp(x) = V —, then 4 - exp(x) = exp(x) for all x e IR. 

n ! 

oo y 

9.16. Is y -Abel convergent? 

^ ' 2 n\nn 
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